Appl. No. 09/808,101 

Amdt. Dated June 2 1 , 2004 

Reply to Office Action of March 19, 2004 

AMENDMENTS TO THE CLAIMS : 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 
Listing of Claims; 

1. (currently amended) A method of classifying a thing as a member of one or more out of a 
plurality of classes, said thing having a plurality of attributes associated therewith, said 
method comprising the steps of: 

(a) for each of said plurality of classes, assigning attribute values based on each of said 
attributes, each said attribute value representative of a relative possibility that said thing is a 
member of the associated class based on said attribute, 

(b) for each of said plurality of classes, aggregating said attribute values using a t-norm 
function, 

(c) selecting a highest aggregated value, 

(d) determining that said thing belongs to the class associated with said highest 
aggregated value, and 

(e) determining a confidence factor based on the relative magnitude of said highest 
aggregated value and a second highest aggregated valuev ; and 

(f) generating a result, based on said detennining steps. 

2. (currently amended) The method of claim 1 further comprising: 

ffl(g) normalizing said attribute values based on the relative information provided by 

each attribute. 
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3. (currently amended) A method of training a machine to classify a thing as a member of one 
or more out of a plurality of classes, the method comprising the steps of: 

(a) providing training data to said machine, said training data comprising a plurality of 
records, each record having attribute data associated therewith, said attribute data comprising 
values associated with a plurality of possible attributes, each record further having a class 
value associated therewith indicating the class to which the record belongs, 

(b) for each of said possible attributes, normalizing said attribute data for each record 
based on the distribution of values present for the attribute in substantially all of said records, 

(c) for each of said records, performing a t-norm operation on the available attribute data, 
and generating a possibility value for each of said possible classes, said possibility values 
corresponding to the relative possibility that the record belongs to one of said particular 
classes, 

(d) for each of said plurality of classes, aggregating substantially all of the records having 
the class value associated with said class, and generating weights for each of the attributes 
according to the degree that each attribute corresponds with a correct determination of said 
class y and 

(e) classifying a thing as a member of one or more out of said plurality of classes based 
on said generated weights, 

4. (currently amended) The method of claim 3, further comprising the steps of: 
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fe}(f) for each of said records, generating belief values for the one or more classes 

having the highest possibility values, said belief value representing the difference between the 
possibility value for said class, and the next highest possibility value, and 

ffMg) generating a list of informative attributes from the attributes associated with 

records for which belief values above a threshold value were generated. 

5. (currently amended) An article of manufacture adapted to be used by a computer, 
comprising: 

a memory medium on which are stored machine instructions that implement a plurality of 
functions useful for classifying an it e m a thing as a member of one or more out of a plurality 
of classes, said thing having a plurality of attributes associated therewith, when the machine 
instructions are executed by a computer, said functions including: 

(a) for each of said plurality of classes, assigning attribute values based on each of said 
attributes, each said attribute value representative of a relative probability that said thing is a 
member of the associated class based on said attribute, 

(b) for each of said plurality of classes, aggregating said attribute values using a t-norm 
function, 

(c) selecting a highest aggregated value, 

(d) determining that said thing belongs to the class associated with said highest 
aggregated value, aad 

(e) determining a confidence factor based on the relative magnitude of said highest 
aggregated value and a second highest aggregated value r and 



Appl. No. 09/808,101 

Amdt. Dated June 21, 2004 

Reply to Office Action of March 19, 2004 

(f) generating a result based on said determining steps. 

6. (currently amended) An article of manufacture adapted to be used by a computer, 
comprising: 

a memory medium on which are stored machine instructions that implement a plurality of 
functions useful for training a machine to classify a thing as a member of one or more out of a 
plurality of classes, said functions including: 

(a) providing training data to said computer, said training data comprising a plurality of 
records, each record having attribute data associated therewith, said attribute data comprising 
values associated with a plurality of possible attributes, each record further having a class 
value associated therewith indicating the class to which the record belongs, 

(b) for each of said possible attributes, normalizing said attribute data for each record 
based on the distribution of values present for the attribute in substantially all of said records, 

(c) for each of said records, performing a t-norm operation on the available attribute data, 
and generating a possibility value for each of said possible classes, said possibility values 
corresponding to the relative possibility that the record belongs to one of said particular 
classes, 

(d) for each of said plurality of classes, aggregating substantially all of the records having 
the class value associated with said class, and generating weights for each of the attributes 
according to the degree that each attribute corresponds with a correct determination of said 
classr ; and 
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(e) classifying a thing as a member of one or more out of said plurality of classes based 
on said generated weights. 

7. (currently amended) The article of claim 6, said functions further including: 

(e)(f) for each of said records, generating belief values for the one or more classes 

having the highest possibility values, said belief value representing the difference between the 
possibility value for said class, and the next highest possibility value, and 

ffl(g) generating a list of informative attributes from the attributes associated with 

records for which belief values above a threshold value were generated. 

8. (currently amended) An apparatus adapted to classify a thing as a member of one or more 
out of a plurality of classes, said thing having a plurality of attributes associated therewith, 
said apparatus comprising: 

an output device and an input device, 
a processor, and 

a memory having machine executable instructions for performing a series of functions 
stored therein, and adapted to receive and store a series of data records, said functions 
including: 

b*)(h) receiving at said input device a data record corresponding to said thing sought 
to be classified, said data record comprising attribute values corresponding to the attributes of 
said thing, 
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f&Ki) for each of said plurality of classes, generating an aggregated value by 

aggregating said attribute values using a t-norm function, 

fi>(0 selecting a highest aggregated value from said aggregated values, 

ffiflc) determining a most possible class from among the plurality of classes based on 

said highest aggregated value, 

fk^(l) determining a confidence factor based on the relative magnitude of said 

highest aggregated value and a second highest aggregated value, and 

ffl(m) outputting said most possible class and said confidence factor at said output 
device. 

9. (currently amended) An apparatus adapted to be trained to classify a thing as a member of 
one or more out of a plurality of classes, said thing having a plurality of attributes associated 
therewith, said machine comprising: 

an output device and an input device, 

a processor, and 

a memory having machine executable instructions for performing a series of functions 
stored therein, and adapted to receive and store a series of data records, said functions 
including: 

(a) receiving training data at said input device, said training data comprising a plurality of 
records, each record having attribute data associated therewith, said attribute data comprising 
values associated with a plurality of attributes, each record further having a class value 
associated therewith indicating the class to which the record belongs, 
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(b) for each of said attributes, normalizing said attribute data for each record based on the 
distribution of values present for the attribute in substantially all of said records, 

(c) for each of said records, performing a t-norm operation on the available attribute data, 
and generating a possibility value for each of said possible classes, said possibility values 
corresponding to the relative possibility that the record belongs to one of said particular 
classes, 

(d) for each of said plurality of classes, aggregating substantially all of the records having 
the class value associated with said class, and generating weights for each of the attributes 
according to the degree that each attribute corresponds with a correct determination of said 
classr ; and 

(e) classifying a thing as a member of one or more out of said plurality of classes based 
on said generated weights. 

10. (currently amended) The apparatus of claim 9, said functions further comprising: 
fe¥f) for each of said records, generating belief values for the one or more classes 

having the highest possibility values, said belief value representing the difference between the 
possibility value for said class, and the next highest possibility value, and 

ffl(g) generating a list of informative attributes from the attributes associated with 

records for which belief values above a threshold value were generated. 

11. (currently amended) The apparatus of claim 10, said functions further comprising: 
fa}(h) outputting said belief values and said list through said output device. 
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12. (currently amended) A neural network comprising: 

at least an input layer and an output layer, the input layer having a plurality of input 
nodes, and the output layer having a plurality of output nodes, such that each of the output 
nodes receives weighted input from each of the input nodes representative of the possibility 
that the particular output node represents the correct output based on the input from a 
particular input node , 

wherein the output nodes aggregate the input from each of the input nodes according to a 
t-norm function, and produce an output representative of the result of the t-norm function. 

13. (currently amended) A neural network comprising: 

at least an input layer, an output layer, and at least one confidence factor node, the input 
layer having a plurality of input nodes, and the output layer having a plurality of output nodes, 
such that each of the output nodes receives weighted input from each of the input nodes 
representative of the possibility that the particular output node represents the correct output 
based on the input from a particular input node , and the confidence factor node receives input 
from each of the output nodes, 

wherein the output nodes aggregate the input from each of the input nodes according to a 
t-norm function, and produce an output representative of the result of the t-norm function, and 
wherein the confidence factor node produces an output representative of the difference 
between the highest output from the output nodes and the second highest output from the 
output nodes. 
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14. (original) The neural network of claim 13 wherein the network includes a plurality of 
confidence factor nodes, each receiving input from each of the output nodes, and the output of 
each confidence factor node is representative of the difference between the output of the n 
highest output nodes and the next highest output from the output nodes. 

15. (original) A universal parallel distributed computation machine comprising: 

at least an input layer and an output layer, said input layer having a plurality of input 
neurons, and said output layer having a plurality of output neurons, such that each of said 
neurons has a weight connection to at least one other neuron, 

wherein said weight connection represents mutual information, and said mutual 
information is represented by a likelihood function of weight. 

16. (original) The machine of claim 15 wherein a value for said weight connections is 
determined by multiplying the likelihood functions for two associated neurons, and 
normalizing the result. 

17. (original) The machine of claim 15 wherein said machine is an analog parallel distributed 
machine. 

18. (original) The machine of claim 15 wherein said machine is a digital parallel distributed 
machine. 
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19. (original) The machine of claim 15 wherein said machine is a hybrid digital and analog 
parallel distributed machine. 

20. (original) A method of training a neural network comprising an input layer having a 
plurality of input neurons and an output layer having a plurality of output neurons, each of 
said neurons having a weight connection to at least one other neuron, said method comprising 
the steps of: 

(a) providing training data to said machine, said training data comprising a plurality of 
records, each record having at least one neuron associated therewith, such that said record 
causes said associated neuron to fire a signal to connected neurons, 

(b) updating weights of said weight connections using a likelihood rule, said rule based on 
the likelihood of each connected neuron firing and of both neurons firing together, v 

(c) aggregating said signals at each said connected neuron with a t-conorm operation, 

(d) evaluating the performance of said machine, and 

(e) repeating steps (a)-(d). 



